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Abstract. We consider the Fluctuation Dissipation Theorem (FDT) of sta- 
tistical physics from a mathematical perspective. We formalize the concept of 
"linear response function" in the general framework of Markov processes. We 
show that for processes out of equilibrium it depends not only on the given 
Markov process X{s) but also on the chosen perturbation of it. We charac- 
terize the set of all possible response functions for a given Markov process 
and show that at equilibrium they all satisfy the FDT. That is, if the initial 
measure u is invariant for the given Markov semi-group, then for any pair of 
times s < t and nice functions /, g, the dissipation, that is, the derivative in s 
of the covariance oi g{X{t)) and f{X{s)) equals the infinitesimal response at 
time t and direction g to any Markovian perturbation that alters the invariant 
measure of X(-) in the direction of / at time s. The same applies in the so 
called FDT regime near equilibrium, i.e. in the limit s oo with t — s fixed, 
provided X(s) converges in law to an invariant measure for its dynamics. We 
provide the response function of two generic Markovian perturbations which 
we then compare and contrast for pure jump processes on a discrete space, for 
finite dimensional diffusion processes, and for stochastic spin systems. 



1. Introduction and outline 

One of the fundamental premises of statistical physics, the Fluctuation Dissipa- 
tion Theorem (FDT) , follows from the assumption that the response of a system in 
thermodynamic equilibrium to a small external perturbation is the same as its re- 
laxation after a spontaneous fluctuation. The FDT provides an explicit relationship 
between the equilibrium fluctuation properties of the thermodynamic system and 
its linear response (e.g. susceptibility), which involve out-of-equilibrium quantities. 
As such it relates the dissipation of dynamics at thermal equilibrium of molecular 
scale (i.e. microscopic) models, with observable macroscopic response to external 
perturbations, allowing the use of microscopic models for predicting material prop- 
erties (in the context of linear response theory). Among notable special cases of 
the FDT are the Einstein relation between particle diffusivity and its mobility [8] 
(or the recent accounts in [11], [19] and |2Q]), and the Johnson- Nyquist formula |22] 
for the thermal noise in a resistor. 
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When deriving the FDT in equilibrium statistical physics one typically starts 
from a measure which is often a Gibbs measure, characterized by a Hamil- 

tonian -ff(-), and a dynamics X{s) for which this measure is invariant. For S > 
small, one perturbs the dynamics so it becomes invariant for the Gibbs measure 
corresponding to the Hamiltonian H(-) + Sf{-). The linear response measures the 
effect of applying such perturbation at time s on the rate of change, as ^ J, in the 
value of a test function g{-) at time t > s (often taking f = g to he the state variable 
of the dynamics in question). This response function (of s and t) is then compared 
to the rate of change in s of the covariance between f{X{s)) and g{X{t)) at equi- 
librium, in the non-perturbed dynamics, whereby the FDT states that the ratio 
between these two functions is merely /3, the inverse of the system's temperature. 

Whereas the FDT is well established and understood in physics, at least in 
or near thermal equilibrium, see jl6l I17j , our goal here is to provide its rigorous 
derivation from a mathematical perspective, as a result about perturbations of 
Markovian semi-groups. This is easy to do in special (simple) cases, most notably, 
when dealing with a Markov process on a finite state space. Aiming here instead 
for a unified derivation, we formalize in Definition 12.71 the concept of having a 
linear response function in the general framework of a family of continuous time, 
homogeneous Markov processes X-f{-) that are invariant for the measures /i-^(-) — 
e-^ (see Assumption 12.51 for the precise setting). In our definition, the response 
function Rxi ,g{s, t) depends on the initial position of the process at time 0, thereby 
allowing us to study the effect of the initial measure on the FDT relation. Though 
this function is uniquely defined per family A"^(-), it depends not only on the given 
Markov process X{-) but also on the chosen perturbation X-f{-) of it (compare for 
example Theorems 14.11 and 14. 2[) . In Theorem 12.101 we characterize the set of all 
possible response functions for a given Markov process X{-) and show that they 
all satisfy the FDT relation (j2.13p . It states that if the initial measure /i*'(-) is 
invariant for the underlying Markov process X{-), then the dissipation, that is the 
derivative in s of the covariance between f{X{s)) and g{X{t)) for s < t equals the 
/i°-average of the infinitesimal response Rxf ^g{s,t) to any Markovian fiuctuation 
X^ that for (5 J, alters the invariant measure of X{-) in the direction of test 
function /(•) at time s, as registered at time t via test function g{-). We show 
in Corollary 12.131 that this FDT relation holds in the limit s — )■ cx) and t — s 
fixed, whenever the initial measure is such that the law of X{s) converges (in the 
appropriate sense) to an invariant measure /x*'(-) and in Proposition l2.14l we specify 
the set of all possible response functions in case of /x-^-symmetric (i.e. reversible) 
Markovian perturbations. Note that the FDT relation has to do with invariance of 
/^°(-) but does not require the Markov process X{-) to be reversible with respect 
to /i'^(-)- To further demonstrate how widely this theory can be used, we construct 
in Section [3] two generic families of Markov perturbations satisfying Assumption 
12.51 which apply for any Markov process (subject only to mild restrictions on the 
domain of certain generators) . Namely, the time change of Propositions 13.11 and 
13.41 and the generalized Langevin dynamics of Proposition 13.21 (in the symmetric 
case) and Proposition 13.81 (in the general, non-symmetric case). The bulk of the 
mathematical work in this paper is in proving that these two generic families admit 
a response function per Definition 12.71 This is done in Theorems 14.11 and 14.21 of 
Section |4] which also provide an explicit formula for the response function in each 
case. 
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Moving to examples of specific Markov processes, in Proposition 15 .11 we use the 
simple sufficient condition of Proposition 12.91 for the existence of a response func- 
tion, to show that essentially all choices of the response function that are possible 
per Theorem 12.101 are indeed attainable in the context of pure jump processes on a 
discrete state space. We also demonstrate there how to create a host of perturba- 
tions via cycle decomposition (for example, perturbation of a Metropolis dynamics, 
or of a Glauber dynamics). In Section [6] we illustrate our generic Langevin pertur- 
bation for diffusion processes on connected, compact, smooth, finite dimensional 
manifolds without boundary, showing in Proposition 16 . 1 1 that it is generated in this 
case by the addition of a smooth drift, which for symmetric diffusions is of gradient 
form. Finally, in Section [7] we demonstrate the fiexibility of our framework by con- 
sidering such a perturbation for infinite dimensional diffusion processes associated 
with stochastic spin systems in the setting of Gibbs distributions. 

All our derivations and results apply even when the Markov process X{-) has 
more than one invariant measure (as is often the case in statistical physics when 
the system's temperature is sufficiently low), and most of them apply also for non- 
reversible dynamics (i.e. having non-symmetric semi-groups). 

We note in passing that the appearance of /3 in the FDT in physics is merely 
due to the definition of Gibbs measure as proportional to e~^^ , with H the cor- 
responding Hamiltonian, and not counting (3 as part of the perturbation Sf. It 
makes more sense for the mathematical version of the FDT to not mention /3 (so 
it in effect corresponds to doing statistical physics at /3 = 1). Also, though from 
a mathematical point of view the response function can not be defined solely in 
terms of the given Markov process X{-), this is never an issue in physics, whereby 
viewing the (Markov) dynamics as a classical approximation of a quantum sys- 
tem, the perturbation of its Hamiltonian in direction /(•) uniquely defines also the 
perturbed quantum system dynamics, hence its classical approximation X^{-) (for 
example, see the physics based derivation in |14j of the FDT in quantum statistical 
mechanics) . 

2. General theory: FDT at or near equilibrium 

A continuous time, homogeneous, strong Markov process X{t) with values in a 
complete, separable metric space S is defined on a fixed probability space (fi, J-, P). 
We assume that X{t) has right continuous sample path and Markov semi-group 
Pth{x) = E^{h{X{t))) G CbiS) for any h e Cb{S). Let V{Pt) denote the domain of 
Pt with respect to the supremum norm. That is, the closed vector space 2?(P() = 
{h G Cb{S) : \\Pth — h\\oo — as t — )■ 0} on which Pj is strongly continuous and 
such that Pt : T>{Pt) 2?(Pt) and denote by !?(£) the domain of the generator C : 
V{C) ^ V{Pt) of the semi-group P* (i.e. V{C) := {h € V{Pt) : f-'^iPth-h) Ch 
in (2?(Pt), II • lloo) for 1 1 0}), which is a dense subset of (ViPt), \\ ■ ||oo)- Recall that if 
g e V{C) then t^Ptg ^ V{C) is differentiable and dtPtg = CPtg = PtCg. 

For example, when S is compact one often has ViPt) = Cb{S) whereas for 
S = W^ one typically has V{Pt) = {ft. -I- c : c e M, /i € Co(5)} for the space Co (5) of 
continuous functions that vanish at infinity. 

The following hypothesis applies throughout. 

Assumption 2.1. We assume that I?(P() is an algebra under point-wise multi- 
plication and a dense subset of L2{ij) for any probability measure ^. We consider 
test functions in a linear vector space Q C 2?(£) such that Q is an algebra with 
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1 G ^ and that Q is dense in (I?(Pt), || • ||oo)- Setting Q {Pi.9 '■ 9 G,t> 0}, we 
further assume that (j){g) G G , Cg G G and gh e f (-C) for all g £ G , h Cz G and any 
(f) e C°^(M). 

As usual we say that a finite measure /i on 5 is invariant for Pf if (Pt^)^ := 
/ Ptgd^ = J gdjj, for all g € i?^ and i > 0. Since G C !'(£) is dense in L2{^), this 

is equivalent to / Cgdfi — for &\\ g & G- 

A key role is to be played by the symmetric bi-linear operator 

rif,g)=C{fg)-fCig)~gCif), 

whose domain is 2?(r) := {{f,g) : / € V{C),g e V{C)Jg € !?(£)} C D(P,) x 
ViPt). One may instead define T as the carre du champ operator for the Dirichlet 
form associated with a /Lt*^- symmetric semi-group P(, thus possibly having a larger 
domain (c.f. [3J Proposition 1.4.1.3]). However, in either case ^ x ^ is a dense 
subset of 2?(r), which is all we use in this paper. 

Let v = vq denote the initial measure of ^(0) and i^t ■— I'oPt the corresponding 
measure of X{t). Fixing < s < t < oo and / e L2(i^s), g G L2{i^t), we denote 
the covariance of the random variables f{X{s)) and g{X{t)) by JCf^g{s,t). By the 
Markov property we have, 

(2.1) /C/,g(s, t) = (P,(/P,_,5)), - (P,/),(Pi.g), . 

The next lemma provides useful formulas for the derivative of the covariance 
with respect to s. 

Lemma 2.2. For any f,g E G and all < s < t < oo, 

(2.2) dsICf-g{s,t) - {P,£{fPt^sg)).-{Ps{fPt-sCg)),-(PsCf),(Ptg). 

(2.3) = / PsT{f,Pt^,g)diy + ICcf.g{s,t). 

Js 

Suppose V is invariant for Pf . Then, 

(2.4) d.lCfJs,t) = -(fCPt-sg).. 

If in addition Pf is v-symmetric (i.e. {fPtg)u — {gPtf)u for all f,g G B^), then 

(2.5) 9,/C/,,(s,t) = i(r(/,Pf_,.g)),. 

Proof: Fix /, g and s, t as in the statement of the lemma, and S > 0. Let D denote 
the right-hand-side of (g^), h = Cg, As = Ps -1 and = d^'^iPs - I) - £. It 
is not hard to verify that 

6-\lCf,g{s + 6,t) ~ ]Cf,gis,t)) ^ D = {PsAsfPt-sg)u - {Ps+sfPt-s-sAsg) 

+ {P,+sfPt-s-s^sh). - (PsAsfPt^sh), + {PsAsf)A'Ptg). ■ 

Recall that {Pf} is contractive for the supremum norm while ||A5ft,||oo and 
liA^/ijloo —i> as (5 I for each fixed h G T^{C). Since / is bounded with /, g, 
/Pf_s5 and fPt-sh in 2?(£), it follows that 

hm d-\JCf^g{s + S,t) - ICf^g{s,t)) ^ D . 

Similar computation applies for the case oi S < 0, thus establishing (|2.2p . Since 
Pt-sCg — CPt-sg for g £ G, the equality (|2.3p is a direct consequence of (|2.ip and 
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the definition of r(-, •). To derive p.4p note that 

D = {C{fVt-sg)).^ - {fCPt-sg)u, - (Pt5>. • 

If V is invariant for then Vg = v and further (Ch),^^ = for any h G T^{C)- 
Consequently, in this case D = —{f CPt-sg)v yielding 1(2 A\ . If in addition Ft is 
j/-symmetric, then obviously {fCh)^ — {hCf)„ for aU f,h e 'D{C), so ()2.5p holds 
by the definition of r(-, •). □ 

Definition 2.3. The Q-convergence as s ^ oo of probability measures Vs on S to 
a probability measure /i on S, denoted ^ ^, means that {h)^_, — )■ (/i)^ as s ^ oo, 
for any fixed h e {fg ,C{f9) ■f^G,9^G}- 

For example, the weak convergence of Vs to /i implies that i^^ as well. 

Corollary 2.4. If — v ° Ps ^ M as s — > oo, then \2.2\) implies that for all 
f,g & G, and any fixed t, 

lim dslCf.g{s,s + t) = {C{fVr9))t. - {fVrCg)^ - (£/)^(P,g)^ . 
// in addition is ^i- symmetric then by li2.5\) , 

lim ^slCfJs,s + T) = l{T{f,Frg))^.■ 

Given an invariant probability measure /i*^ for Pt we consider throughout the 
following setting (where the Banach space B is typically L2{fjP) or {Cb{S), || • ||oo))- 

Assumption 2.5. The norm topology on a Banach space {B, \\ ■ ||) of -integrable 
functions is finer than the one induced by Li{^^) and \\h\\ < ||ft.||oo for all h G 
2?(Pt) C B. For each f (z G there exists a continuous time, homogeneous Markov 
process X-^ (t) with a contractive semi-group P{ on (6,11-11) such that \\F{h-h\\ 
as t ^ for any h G T>{Pt) and the finite, positive measure ^i^ on S such that 
dji^ /djjP = e-^ is invariant for P{ . Further, X^(t) = X{t), the subspace Q is 
contained in the domain of the generator o/P{, and g ^ Q for all g (z G ■ 

Remark 2.6. It is easy to verify that all results and proofs of this section remain 
valid in case /i-^ — e*'^-*/!*^ as long as ^ : Q ^ Bg is such that for any fixed f & G 
the functions ipg := (5~^(e*'-*-^' — Sf — 1) converge to zero in Li(/i'^) when (5 J, 0. 

The FDT is about the relation between derivatives of the covariance at equi- 
librium and the response of the system to small perturbation out of equilibrium. 
We turn now to the rigorous definition of the latter (see also Proposition 12.91 for 
an easy sufficient condition for existence of such response, in case C is bounded on 

Definition 2.7. Assume \2.5\ and that for any f (z G there exists a linear operator 
Af : T>{A.f) I— > B whose domain T>{A.f) contains G, and such that s i— )■ A/P^g is 

strongly continuous in (B, || • ||) for each g (z G ■ If moreover, for any T > 0, g G , 
all t G [0,r] and S > 0, 

(2.6) \\S-\P'/ -Pt)g~ I PsAfPt-sgds\\<r]st, 

Jo 
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and rjs = ris{f, T) — >■ as S I 0, then we call 

(2.7) Rxfjs, t) = P,A/Pt_,.g e B 

(which for any t > is strongly integrable on [0, t]), the response function (at time 
t and direction g) for the Markovian perturbations on Q (applied at time s). 

Note that Rxf .gi^jt) is uniquely defined per given Markovian perturbations 
X^{-). Indeed, suppose that for some f & G the inequality (12.61) holds for the same 
semi-groups P^^ and both linear operators Ay and A/. Then, taking S 10 we see 
that the linear operator — Af — Af is such that for alH > and g ^ G, 

(2.8) t^^ f PsAAgds + t-^ f Pt_,A^(P, - I)gds = . 

Jo Jo 

With P^ strongly continuous, upon taking t I the left-most term converges to 
A^g, whereas Pt_s A^(Ps — T)gds — > by the contractivity of Pt-s on 

{B, II • II) and the assumed strong continuity of A^P^g. Consequently, Af = Ay on 
the set G, and so using either operator in ()2.7p leads to the same response function. 

As we demonstrate next, Rxf,g{u,a + t + b) of (|2.7|) is merely the effect in 
"direction" g and at time a + t + b, of a small perturbation of the dynamics in 
"direction" / during the time interval u £ [a,a + t], in agreement with the less 
formal definition of response function one often finds in the literature. 

Corollary 2.8. For any f,g (z G, each T > a,b,t > and all 5 > 0, a response 
function of the form {2. 7\ l must satisfy the inequality 

(2.9) \\S-'Pa{PV - Pt)Pbg - I ^ Rxfju, a + t + b)du\\ < T^st , 

J a 

for rjs = 775(6, /, g,T) ^0 as S 10. 

Proof: Using the expression (|2.7p to write (12.91) more explicitly, one finds that for 
a = the latter is precisely (|2.6I) for v — b, hence it obviously holds. Moreover, in 
case a > we merely consider the norm of Pah^ , where is the element of B the 
norm of which we consider in (|2.6p . As Pa is contractive on {B, \\ ■ ||), we have that 
(|2.9p holds also in this case. □ 
We provide now an explicit sufficient condition for the existence of a response 
function of the form (j2.7p when C-^ , C and A/ are bounded operators (as is the 
case in the setting of Section [5|). 

Proposition 2.9. Assume \2.5\ holds. If for each f £ G, the operators Af,C, L^^ , 
(5 > are bounded on (B, \\ • ||) and the corresponding operator norms are such that 

(2.10) \im\\S-\C'f -C)-Af\\^0, 

then 112. 6\) holds and A/P^g is strongly continuous, for each g £ G- 

Proof: Since \\AfPs+vg - A/P^„5|| < ||A/|| \\Psg-g\\ for g = P^g, the strong 
continuity of s 1— >■ A/P^g is a direct consequence of the strong continuity of P^ on 
its domain. Fixing f,g £ G and t; > it remains only to show that f~^||p( || as 
5 0, uniformly over t G (0, T], where 

pf := S-\P'/ -Pt)g- f Pt-uAfP^gdu . 

JO 
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To this end, let rt :— — Jg Pt-uA.fPugdu and note that 

dtpf = S-\C'fp'/ - CPt)g-AfPt9 + Cn , 
which imply, after some algebraic manipulations, that 

(2.11) dtpf = C'fpf + Cf , 
for 

(2.12) Cf iC - C'f)n + [5-\C'f - £) - A;]P,g . 

It is not hard to show that the solution of (|2.1ip with initial condition = 0, is 

= fplUtds. 
Jo 

With both Pt^ and contractive on {B, || • ||), we thus have that \\rt\\ < i||A/||||5|| 
and for any t £ [0,r], 

WpfW < r||CfN-s<t[T||/:-£^/||||A;|| + ||5-i(£^/-/:)-A/|l]||5||=:%(/,5,r)t. 
Jo 

Finally, note that from (|2.10l) we have that 775 — >■ as (5 | 0. □ 

Our next theorem characterizes the type of response functions one may find. It 
also proves the FDT, showing that if X^{-) has a response function Rxt\g{s,t), 
then the average of the response function according to an initial measure 1^0 = /i" 
which is invariant for X{-), equals the time derivative of the covariance of X(-) 
under the same initial measure. 

Theorem 2.10 (Fluctuation Dissipation Theorem). Let f <E Q . If {■) has a 

response function, then A/1 = and Arf — rAj for all r > 0. Further, then 
((Aj + f C)g) ^0 — for allTj £ Q and consequently, if the initial measure = pP , 
then for any s < t, 

(2.13) dsJCs,g{s,t)^{Rxf.g{s,t)),,. 

Remark 2.11. IfPt is pP -symmetric and f,g E L2{p^) with {f,g) E T^{P), then 
by spectral decomposition we have the Green-Kubo formula 

-{fCg)^o = ^{rif,g))^o^ l^^[{iP,Cf)iCg)),,o]ds 

(cf [15j Theorem 4.3.8]j. Applying it for f and Pt-s9, we get the alternative 
expression 

POO 

dsJCf,g{s,t)^ / [{{PsCf){CPt-sg))^o]ds 

JQ 

for the dissipation term. In contrast with this identity does not involve a 

perturbation of the given Markovian dynamic. 

Proof: Fix f E g. If g = 1 then P„g = Pf/ g = 1 for all S > and u > 0, so in 
this case taking (5 in (|2.6p we find that for any t > 0, 

t-^ J PsAflds = 0. 

Thus, taking t ^0 we have that A/1 = 0. 
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Next, fixing r > 0, note tiiat Pf ''•'^^ = Pf '■^■'^ for all 6 > 0, hence by ([23]) we 
have for = A^/ — rA y , 

II / PsAAPt-s9ds\\<Mrf,9,T) + rTjsr{f,9,T)]t. 
Jo 

Taking S I this implies that (j2.8p holds for = A^/ — rA/ and all t > 0. 
Hence, by the argument we provided immediately following p.Sp . we deduce that 
A.Ag = for all g ^ G- That is, without loss of generality we may assume that 
Arf = f-^f, as claimed. 

Let tps = S^^{eJ^ — Sf ~ 1). Since fi^-^ is invariant for Pf-^ and /i° is invariant 
for Pf, it follows that 

{5-\P'/ - Pt)g),o = {Ml P'/m.o - ifiP'/ ~ Pt)g),o - (/(P, - I)g)^o 
■■= FiiS) + F2i6) + F3 . 

With (I2H) implying that ||(Pt^' - Pf)?|| ^ as ^ ; (hence so does (KP^^ - 
Pt)5|)^o), and ||/||oo < 00 we deduce that F2{S) — > 0. Further, {\ips\}fj.o — >■ when 
5 I (since / is bounded), while || (I — Pt'^)5||oo < 2|jg||oo is uniformly bounded in 
S, resulting with Fi{S) — >■ as well. We thus deduce by considering the hmit S 10 
in p.6p . and applying Fubini's theorem, that for any t > and g G G, 

{ft-\Pt~I)g)^o+t-' f {Pt-sAfP,g)^ods = 0. 
Jo 

Further, with invariant for Pf and having assumed strong continuity of s i— > 
A/Ps5, upon taking t \.0 we find that 

(2.14) {fCg)^o + {A fg) ^0=0, 

as claimed. 

Next, recall p.4p and (j2.7p that for i^o — M*^ which is invariant for Pg and for 
any finite s <t, 

dslCf,gis,t) - {Rxf,g{s,t))f,o = -(/£P4_,g)^o - (A/Pt_,.g)^o =0, 
where the right-most identity is precisely p.l4p . □ 

Combining Corollarv 12 .41 and Theorem l2.10l we deduce the existence of the FDT 
regime in out-of-equilibrium dynamics whenever X{s) converges in law (in the ap- 
propriate sense), with the limiting measure /i" being invariant for X{-). That is, 
the FDT relation (|2.13p then asymptotically holds for i — s = r fixed, in the limit 
s — >■ 00. Specifically, similar to Definition l2.3l we define the notion of C//-convergence 
as follows. 

Definition 2.12. The Gf -convergence of probability measures Vg on S to a prob- 
ability measure fi on S, denoted Vg -A H, means that {h)^^ — > (/i)^ as s — > cxi, for 
any fixed h g {fg, C{fg), A^g : g G G} (implicitly assuming that Ajg G Li[vg) 
for all s large enough). 

Corollary 2.13. Let vq denote the initial measure of X{0) for anS-valued, contin- 
uous time, homogeneous, strong Markov process X{t) such thatX^{-) has a response 
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function (in the sense of Definition \2.'7\ l . Suppose further that = i^Q o — i fjP 
as s oo. Then, for any g G G and fixed t > 0, 

(2.15) lim dslCf,g{s, s + r) = -{fCPrg)n° = lim {Rxfn{s, s + r))^^ . 

Proof: The left side of the identity follows from the formula for the limit of 
dslCf^g{s,s + t) given in Corollary 12.41 and the fact that jjP is invariant for Pt so 
{Ch)^o = for aU h e V{C). Reeah ([27]) that (i?x/,g(s,s + t))^^ (A/P^g)^^ 
which converges to (A/P^g)^o as s — )■ oo. From Theorem 12.101 we have that 
((A/ + fC)Prg)f_iO — 0, which thus yields the right side of the stated identity. □ 

We conclude this section with a statement characterizing response functions for 
symmetric perturbations. 

Proposition 2.14. Assume \2.5\ holds for the Hilbert space B = L2(m'') and that 
for each f & G the semi-group P{ of X^{t) is -symmetric. Then, any response 
function of the form \2. 7] ) is based on Af = — fC for a linear operator B f which 
is -symmetric on G ■ 

Remark 2.15. The stated -symmetry of = A/ + fC is necessary in this 
setting of symmetric perturbations. However, typically more is required from B/ m 
order to assure the existence of a response function of the form \2. 7| ). 

Proof: Note that for any 5 > and all g,h E G, 

Fs{h,g) 6-'(h{P'/ -Pt)g}^o + (hf{Pt~l)g)^o 

- (hMI - P'/)g)^.o - {hf{P'/ - Pt)g},o 
+ S-\h{P'/ - l)g}^sf ~ S-\h{Pt - I)?)^o 
=: F, {S, X g) + F2 {5, \ g) + F3 [5, % g) + Fi{5, % g) , 

where ^5 — 6^^{e^^ —Sf—l). Recall that || (I— P(''')5||oo < 2||g||oo, /i is bounded and 
ili'sDt," 0, hence Fi{S,h,g) ^ as J i 0. Further, {\{pI^ - Pt)5|)^o ^ hence 
also F2{S, h,g)^OasSlO. By the /i'^-'^-symmetry of Pf'^ and the /^"-symmetry of 
Pt, it follows that 

Fs (J, K9)^F3 (S, ?, h) , Fi (J, h, g) ^ F^S, 5, h) , 

for any S > 0. Consequently, as 5^0, 

Fs{h,g)-Fs{g,h)^0 

which by (j2.6p and the /^''-symmetry of Pt-u amounts to 

(2.16) Et(h,g) = Etig,h), 
where 

EtiKg) / {{Pt-sh)iAfP,g))^o ds + (hfiPt ~ I)g)^o . 
Jo 

Since s 1— > A^P^g is strongly continuous (as part of Definition 12.71 of the response 
function), it follows that as t J, 0, 

/ (hAfPsg)f,ods + t-\hfiPt-I)g)^o ^ (hAfg)^o + (hfCg)^o = (hBfg)^o . 
Jo 
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Further, for all m > 0, 



(P„ = [ PyChdv, 

Jo 



hence || (P,i — I)/i||oo < w||£/i||oo, while the strong continuity of A/Psg implies that 
supg^j IIA/Psgll — > ||A/g|| < oo as 1 1 0. Taken together, these imply that 

limt-i / {{{Pt-s-I)h){AfFsg))^ods^O, 

t^O Jq 

and consequently we have also that 

We thus conclude, based on p.l6p . that (/iB/g)^o — (gB//i)^o for any ^ Q, as 
claimed. □ 



3. Generic Markov perturbations 

In this section we construct several generic Markov perturbations for which As- 
sumption 12.51 holds. Our presentation is somewhat technical because we aim at 
addressing a rather general framework. The reader may thus benefit from consid- 
ering first the concrete examples of Sections [5] and El 

Time change. Our first construction corresponds to changing the clock as follows. 
For each fixed f E G and s > let 

Jf) 

Note that : M_|_ x — > M_(_ is a measurable stochastic process the sample path 
of which are everywhere differentiable with -j^t^ = e^'^^^-^^^ bounded and bounded 
away from zero. Its inverse, (t) := inf{s > : i'^(s) > t} is thus also a measurable 
stochastic process, the sample path of which are everywhere differentiable with 
■^T^ — erf'^^'y^ (*))) uniformly (in t and iS) bounded and bounded away from zero. 

Proposition 3.1. Assumvtion \2.5\ holds for {B,\\ ■ ||) = {Cb{S),\\ ■ ||oo) and the 

Markov process (t) = X{Tf{t)). Further, the generator Cq of the semi-group 
(P^)t ofX^{t) IS such that V{C) = V{Cl,) and C^g = e'f Cg for any g G V[C). 

Proof: Obviously, {r^ (i) < s} = {t^ (s) > t} is in = (7{X{u) : Q < u < s) 
by the right continuity and boundedness of u H> exp(/(X(M))). Hence, for each 
fixed i, the random variable {t) is a stopping time with respect to the canonical 
filtration Fs of Similarly, the stochastic process 

Jo 

is adapted to the canonical filtration J"/ = a{X^{u) : < u < i) of {Xg (•)}. The 
strict monotonicity and continuity of f i— > (t) imply that J- 1 = -^Tfit) aiid further 
it is not hard to check that T^{t,uj) have the regeneration property 

(t, w) = r-^ (s, w) + T-^ (i - s, r w) , 
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for any t > s > (where 9"uj{-) = uj{u + •) denotes the usual shift operator). Thus, 
for any h E Bg, t > s > and x E S, by the strong Markov property of X{-) at 
r/(.), 

E,[h{XimTf] = E,[/i(X(T/(i)))|^,/(,)] 

(3.1) = Exirfis))[h{X{Ti\t~s)))]=E^f^^^[h{xf{t-s))], 

where X{-) and -'^o(') denote independent copies of X{-) and ^o(-); respectively. 
The Markov property of Xq{-) then follows from (|3.ip by standard arguments. Since 
Xq{-) assumes its values in a complete, separable metric space, the contractive semi- 
group P{h — Ex{h{XQ{t))) is well defined on {Cb{S), \\ ■ \\oo)- Further, by the change 
of variable v = {u) its resolvent is given by 

/•OO /"OO 

Ii{h = E^ / e-^'"'h[xl{u))du ^E^ e-^*^(^)e^(^(''»/i(X(i-))df 
'-Jo J LJo 

Note that Xt^ (s) — Acs — S^{X{u))du for positive, finite c = exp(||/||oo) and the 
continuous function ^(x) = A(c — e^*^^-*) > with ||^||oo < Ac. The linear operator 
RacC : 2'(Pt) ^ T^i^) such that 

poo 

(Rac05 = E. / e-^''^{X{s))g{X{s))ds 
'-Jo 

is thus strictly contractive, and since the series 

R{;i = ;^(RAcO'RAc(e-'7i) 

A;>0 

converges uniformly, it follows that R{ : 2?(Pt) T^(Pt) and consequently P{ : 

Fixing g G 2?(£) recall that g(X(-)) and {£g){X{-)) are bounded right-continuous 
functions, with M(t) := g{X{t)) — g{X{0)) — Ji^{Cg){X{v))dv a right-continuous 
martingale with respect to the filtration J^f With M(0) = and t-^ {t) bounded 
above uniformly in ui, by Doob's optional sampling theorem ExM{Tf (t)) = for 
any x E S. By the change of variable v — (u) and Fubini, this amounts to 

(3.2) F{g{x)^g{x)+ f E.,[{e-f Cg){Xf' {u))]du ^ g{x) + f {Ple-f'Cg){x)du. 



Let g = e~^Cg G 2?(Pt). Since is contractive on 2?(Pt), it follows from 
that \\P(g — g\\oo < ^llslloo- In particular, \\P{g — .g||oo — > as i | 0, for all g E Q. 
With Q dense in the closed vector space (I?(Pt), || • ||oo), we have that P{ is strongly 
continuous there. The uniformly bounded and strongly continuous P^g : [0, t\ 
Cb[S) is also strongly integrable, so p.2p implies that for any g E 'D[C), 

lim||i-i(P{g-g)-g||oo =lim||i-i [ Vigdu^gW^^Q. 

t^O t^O Jq 

We have thus seen that V{C) C V{Cl) with C^g = e^^Cg for aU g E V{C). 

We next prove that if 5 G 2?(£q), then necessarily g E 'D{C). To this end, 
observe that the sample path of X^ [t) inherits the right continuity of those of 
X(t), and fixing g E 'D{Cq) (which is thus continuous and bounded), we have the 
right-continuous martingale AP' (s) = giX^ (s)) - giX^ {0)) - {Clg){Xf {v))dv 
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with respect to the filtration J^/. With Af-^(O) — and the stopping time t^{s) 
for the latter filtration bounded above uniformly (in w), by the optional sampling 
theorem E^Mf{tf{s)) = for ah x € 5. Since Xf{tf{u)) = X{ u), using Fubini 
and the change of variable v = (u) we get in analogy to (|3.2p that 

Fsgix) = 9{x) + / (P„e^45)(x)du , 
Jo 

which by the uniform boundedness and strong continuity of Pu^^^^g results with 
g e VlC) (and £g = C{^g), completing the proof that £q = C. 

In particular, Q C D(Cl) and since Q is an algebra containing both e~-^ and Cg, 
it follows that C^g & Q for any f,g^G- It remains just to verify that ^.^ is invariant 
for Pj , that is, / C^T'lgd^^ = for aU t > and g £ Q. We have already shown 
that ] Clvigdiif = / C{F{g)dn°. The latter is zero since F{g e V{Cl) = V{C) 
and is invariant for Pt, so the proof of the proposition is complete. □ 

Perturbations for symmetric processes. Relying on the powerful technology of 
Dirichlet forms (c.f. i2[), the second generic case we consider is that of a generalized 
Langevin dynamics for a /i'^-symmetric process. 

Proposition 3.2. Suppose Pt is fjP -symmetric. Then, for any f £ G there exists a 
Markov process x( such that the generator of its -symmetric, strongly continuous 
semi-group (Pi)t on the Hilhert space B = i2(M ); satisfies 

(3.3) cig^Cg-^^e-fTief,g), Vg G G 
and for which Assumvtion \2.5\ holds. 

The Leibniz rule T{fh,g) — hT{f,g) + fT{h,g) applies whenever C is the gen- 
erator of a Markov process of continuous trajectories t i-^ X{t) (c.f. [T]), resulting 

with c{g = Cg + ^T{f,g) as soon as r(^j,^,^ ijiff) ~^ when n oo. We call 
X( a generalized Langevin dynamics since for S a finite dimensional, compact, 
connected smooth manifold without boundary, the perturbed process x({-) is then 
obtained by adding to the original (diffusion) process a drift of a gradient form (c.f. 
Section E]). 

Remark 3.3. Provosition \S.2\ vrovides us with a semi-group (Pi)t of X( that is 
defined only for almost every x G S. In most interesting specific situations one 

easily shows that {P{)t is the unique extension to L^iiJ-^) of a semi-group (Pi)t 
that is strongly continuous on (I?(Pt), || • ||oo) such that (P{)t/i(a;) = E^(ft,(X/(t))) 
for all X £ S and h G Cb{S). Our proof of the proposition also shows that if f{-) is 
constant on S then Ci = L is merely the closure of C for the Hilhert space L2{fjP). 

Proof: Fixing f E G, we construct the continuous time, homogeneous Markov 
process x( on the Hilbert space H ~ L2{tt-^). To this end, consider the bi-linear 
form 

(3.4) £f{h, g) := {h{-C{)g)^f , V.g, h&Vf, 

where Vj := {g : e-^g € T^i^)} H ^{C) is a linear subspace of H and C(g := 
Cg + ^e~^r{e^ ,g) is a linear operator from Vf to H. Our assumptions imply that 
the algebra t/ is a subspace of 2?/, hence the latter is dense in H. Recall that Pt is 
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//^-symmetric, so the same applies for its generator Z (i.e. {hCg) = {gCh)^a for 
all g,h £ !){€)). It is easy to check that thus C( is /x^-symmetric and consequently, 
£f{-, •) is a symmetric form on Vf x Vf. Further, by the definition of C and the 
//^-symmetry of Pt we find that for any g G Df, 

(3.5) £f{g,g) = ^{g^Cef)f,o ~ ^{gefCg)f,o ~ ^{gC{efg))^o = \im£f^t{g) , 
where for any i > 0, 

(3.6) £fA9) ^(5' - 2gPtg + Ptg^),f = l(E,[(g(X(t)) - ^(x))^])^, > , 

and consequently £f{g,g) > as well. The non-negative quadratic form £/ on the 
dense subspace ~ I?/, is then closable (c.f. [H Example 1.1.3.4]). The closure 

£f of f/ determines a unique strongly continuous semi-group (Pf)* of self-adjoint 
contractions on V. (c.f. [21 Proposition 1.1.2.3]). The generator Ci of (P;^ )* is (up to 
a sign inversion) the Friedrichs extension of —C{, that is, a non-positive self-adjoint 
operator on T-l satisfying p.3p for all g G Vf (c.f. [2, Example 1.1.3.4]). 

For e > let : R — > [— e, 1 -f e] be infinitely differentiable functions, such that 
ip^{t) ^tioTte [0, 1] and < (p,{t2) - ifidh) < i2 - if h < ^2 (see Problem 
1.1.2.1] for a construction of such functions). Obviously, for any e,t > 0, g £ 2?(Pf) 
and fj,-^ almost every x £ S, 

E4i^4giXit)) - ^e(g(x)))2] < E,[(.9(X(t)) - g{x)f\ . 

By p.6p this implies that £f t{(pf{g)) < £f t{g)- Further, recall that when g £ Q also 
'/'e(S') G 5 ^ in which case it follows from p.5|) that £f{ip^{g),ip^{g)) < £f{g,g). 
As this holds for all e > and on the dense subset G of !?[£/], we conclude that 
£f is a. symmetric Dirichlet form in H (c.f. [21] Proposition 1.4.10]). Consequently, 

the strongly continuous semi-group (Pf )t of self- adjoint contractions on y. is sub- 
Markovian (c.f. [2, Proposition 1.3.2.1]), and in particular jjP-almost everywhere 

{Fi)t'ip > whenever /z°-almost everywhere ip > (c.f. [21 Definitions 1.2.1.1 and 
1.2.4.1]). Recall that 1 £0 and £1 = (since Pt is Markovian), implying by (|X3l) 

that = as well. Consequently, (P^)* = e*'^! (c.f. [2, Proposition 1.1.2.1]), is 

Markovian as claimed (that is, also {Pi)tl = 1 for all t > 0). □ 

In carrying out the construction of Langevin dynamics in a non-symmetric set- 
ting we use the following analog of Proposition 13.11 which applies in the Hilbert 
space L2[y.^) for any /i'^-symmetric Markov semi-group Pt on L2{yP) (possibly 
no longer defined point-wise, and even when the corresponding Markov process is 
neither strong Markov, nor has right continuous sample path). 

Proposition 3.4. // Pt is fjP -symmetric Markov semi-group on the Hilbert space 
L2{fjP) with a generator C, then A ssumvtion \2. 51 holds for a ji^ -symmetric, strongly 

continuous Markov semi-group (Po)t on B ~ L2(/i-'), whose generator Cq has the 
same domain as C and is such that 

(3.7) cig = e-fCg, V.9 e !?(£) . 

Proof: Since Pt is a /Lt^-symmetric sub-Markovian semi-group on L2{fjfi), with 
domain that is dense in L2{^jP) (on account of ^ C !?(£) being dense in L2(/^°)), 
its generator £ is a Dirichlet operator, namely, a (negative), self-adjoint operator 
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on L2{fjP) of a dense domain on which {{h — 1)+Ch) < (c.f. [21 Proposition 

1.3.2.1]). Fixing f € G, the hnear map Cq from the dense subset of L2{n^) 

to L2{fJ.^) given by p.7p is a symmetric operator on L2{^^), as 

(/ii£o^2)p/ {hiCh2)^o = {h2Chi)^o = {h2cihi) 

for aU hi,h2 G '^{C). Further, if /i, £ L2{^^) are such that {hC^g)^! — {(f>g)fj_f 
for aU g £ T^iC^) — 'D{C) then of course (/i£(/)^o = {e^(j)g)^o for h,(j) G L2(^°). 

y 

With £ self-adjoint on L2(/i") this imphes that h e and (j) — e^^Ch — C^h, 

namely, the symmetric operator /!q is self-adjoint on L2(/i'^). Clearly, 

{{h - 1)+Cih)^s - {{h - l)+Ch)^o < 

for all h e T^iC) — 'D{Cq). We thus deduce that Cq is a Dirichlet operator 
on L2{iJ,^), hence the generator of a /x-'^-symmetric sub-Mar kovian semi- group on 
L2{fJ.-^), denoted hereafter (Pq)* (for example, apply again [21 Proposition 1.3.2.1], 
now in the converse direction). Finally, with Pt a Markov semi-group, we have that 

y 

1 e T^iC) and ^"-a.s. CI = 0. Of course, the same applies /i-'^-a.s. for Cq of (|3.7p . 

y 

Consequently, (Pq)* is actually a /i^-symmetric Markov semi-group on L2{fJ--^) (e.g. 
[21 Exercise 1.3.1]), as claimed. □ 

Langevin dynamics in a non-symmetric setting. Building on Propositions 
I3.1l and l3.2l we shall construct a generalized Langevin dynamics when /.t" is invariant 
for the strongly continuous Markov semi-group Pt on I'(Pt) (of a strong Markov 
process of right continuous sample path X{t) valued on a complete, separable metric 
space iS), now in case P* is not /z°-symmetric. This construction is more complex 
than what we have seen in Proposition l3 . 21 and it involves certain (mild) restrictions 
on the domains of various generators. We start by letting Pj denote the extension of 
Pt to a /i'^-invariant strongly continuous, Markov semi-group on the Hilbert space 
L2{n°) and Pt the adjoint of Pt in L2(^°). The adjoint semi-group (Pj)t>o is then 
strongly continuous in L2{n^) and its generator C is the adjoint of the generator 
C of Pt (see [ini Theorem 4.3]). Further, since Pf is //^-invariant and Markovian 
on L2{n°), the same applies for P^ . 

Let T{h, g) = C{gh) — hC{g) — gC{h) denote the L2(/i°) extension of T. We seek 
a perturbed Markovian semi-group whose generator has the form 

C{ = C + ]^e-fT{ef + Ca , 

where C — ^{C + C ) and Ca = \{C — C ) correspond to the symmetric and anti- 
symmetric parts of £, respectively. Indeed, it is easy to see that C^ is /x-^-invariant 

and Ci —> £ for (5 4, 0. However, while £ is a generator of a Markovian semi-group 
(as shown in Corollarv 13. 7p . this is not the case for Ca- Hence, we alternatively 

y y 

construct Ci in Proposition 13.81 as the sum of the Markovian generators Cq of 
Proposition 13.41 and C^ which we construct next. 

Lemma 3.5. Suppose Pt is a -invariant strongly continuous Markov semi-group. 
Assume further that Q C !?(£ ) and C g € G for all g £ Q . Then, for each non- 
negative f £ G there exists a Markov process such that the generator of its 
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fj,^ -symmetric, strongly continuous semi-group P{ on the Hilbert space B — L2(/i-' ), 
satisfies 

(3.8) Cfg = (1 - e-f)(^Cg + ^C*g) + ie-^r(e^g) , ^g e G 
and for which Assumption 1 2. 51 holds. 

Proof: Fixing a non-negative f ^ G, consider the hnear subspace 

(3.9) Vf {h : e^h e V{C)} D V(C) n V(C*) 

of v. = L2{n^) and the hnear operator from Vf to H, defined via (13. 8p . It is 
not hard to verify that is /i ■''-symmetric operator on Vf, with the associated 
symmetric bi-hnear form 

(3.10) SfiKg) := -(/i£^<?)^/ 

= 2 (f^^id - 9e^))tJ.'> + {9^{h- he^))^o {gh£e^)f,o 

Since C and its adjoint C* are the generators of the /i°-invariant, strongly continuous 
semi-groups P* and P( on L2{ijP), similarly to p.Sp . we further have that for any 

(3.11) Sf{g,g) = ^{g'^Ce^)f,o -\- {gCg)^,o - {gC{e^g))f,o = limf/,t(5) , 
where for any t > 0, 

(3.12) EfM ^((e^ " l)!^' - '^Q^ta + Ks'Dm" > > 

in view of the non-negativity of /. Hence, £f{g,g) > for all g e Vf, and since 
by our assumptions G ^Vf, we conclude that the non- negative quadratic form £f 
of dense domain Vf is closable, denoting by its closure, and by Pt and the 
corresponding strongly continuous semi-group and generator. Since P^ is a Markov 
semi-group, by the same argument as in the proof of ProDOsition l3.2l we deduce that 
replacing g by (pe{g) reduces the value of g"^ — 2gP^g -I- P^g^ > 0, implying that 
£f^t{fe{g)) < £s,t{g) for all e,t > Q and g & G, & dense subset of V[£f]. Arguing 
again as in Proposition 13.21 we conclude that is a symmetric Dirichlet form in 
y. with Pt = e'^^^ a strongly continuous Markovian semi-group (recall that 1 lE G 
and £1 = £*1 = 0). □ 

Remark 3.6. Though Assumption \2.5\ holds for the ^i^ -symmetric Markov semi- 
group P{ , the Fluctuation Dissipation Theorem \2.1 (A fails in this case, for C^^ of 
p.8p converges to zero as <5 J, (and not to C). We thus need the additional 
ingredients of Provosition lST^ in order to complete the construction of the Langevin 
dynamics in non-symmetric setting. 

Considering Lemma [3751 for f — 1 and then Proposition l3.4l for / = log(l — e~^)l 
we get the existence of the following symmetric Markov process. 

Corollary 3.7. For any f/* -invariant strongly continuous Markov semi-group Pt, 
if G ^ V{C ) and C g €z G for all g E G, then Assumvtion \2.5\ holds for a Markov 
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process X on the Hilhert space L2{^i^). The generator of its -symmetric, strongly 
continuous semi-group Pf is such that for any g € T^iC) H ), 

(3.13) Cg^^Cg + ^C*g. 

We complete our construction by adding to the generator of Lemma 13.51 an 
appropriate non-symmetric perturbation (taken from Proposition 13 . ip . 

Proposition 3.8. Suppose as in Lemma \3.5\ that f (z G is non-negative and 
C (G) C G. Further assume that 'D{C) is contained in the domain of the gen- 
erator of Xf . Then, Assumption \2.5\ holds for a ij^^ -invariant Markov process 
Xi on B = L2(m )• The generator of its strongly continuous semi-group (Pi)t 
has the same domain as C and is such that 

(3.14) £{ = & + e-^'C. 

Remark 3.9. Provosition \3.8\ is the non-symmetric generalization of Proposition 
\8.'/^ since if Pf is -symmetric then C ^ C and the operator of {3.14^ and the 
corresponding Markov process coincide with (and Xl) of Proposition HOI Also 
note that since each f (z G is bounded below, you have the non-negativity condition 
of the proposition by adding to any given f G a sufficiently large constant, without 
changing the corresponding normalized invariant measure / ii^{S). 

Proof: From Proposition 13. II we get the Markov process xl{t) on [Cb{S), \\ ■ ||oo) 
whose semi-group is generated by — e^^ L and is invariant for ix^ . Let Pq 
denote the extension of this semi-group to L^i^ii' ) and its generator. Since / 
is bounded it is easy to see that cIq — e^^ C has the same domain as C. Subject 
to the assumptions of Lemma 13.51 we get the /.t-^-symmetric Markov semi-group 
pf on the same Hilbert space, whose generator satisfies p.Sp . In particular, 
by Hille-Yosida theorem we know that is a closed operator, so our assumption 
that its domain contains the domain of C implies that the operator >cf (on !?(£)), 

given by p.l4p is a generator of a strongly continuous semi-group P^ (c.f. [5J 
pages 631-639]). Further, with e^ & G (an algebra) such that both £{G) C G and 

C {G) C G, we have the same properties for £q and , hence for £i as well. 
The latter operator is the sum of the generators of two /x^-invariant Markov semi- 
groups, so by Trotter's product formula (c.f. [TOl Theorem 8.12]), we conclude that 
the corresponding generated semi-group is both Markovian and /i-^-invariant. D 

4. The corresponding response functions 

The response function is not determined just by the given Markov process X(-), 
its invariant measure fjP, and the perturbation function f ^ G- Indeed, Theorem 
14.11 provides the response function of the Markovian perturbations of Propositions 
13.11 and 13.41 while Theorem 14.21 provides the response function for the Markovian 
perturbation of Proposition 13.81 under the uniform control of (|4.ip on the anti- 
symmetric part of the generator C. See also CoroUarv 14.61 for the simpler response 
function in the symmetric case of Proposition |321 Typically the response functions 
in these two theorems are not the same. 
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Theorem 4.1. Taking (B, || • ||) = {Cb{S), \\ ■ \\oc), the Markov perturbation xl{t) 
has a response function of the form {2. 7^ , with A/ = (-A-o)/ = —fC 

Proof: Recall that X^lt) satisfies Assumption [231 for (S, || • ||) = (Cb(5), || • ||oo)- 
Fixing f E G, observe that I?((Ao)/) = 'D{—f£) = which contains Q by our 

assumptions about Q. Further, by strong continuity of P.; on (T>(Pt), \\ • ||oo) it 
follows that for each given g £ G, 



f _ 
t — 



(Ao) fP sg^-f CP sg^-fPs{Cg), 

is also strongly continuous. Fixing 5 — Pvg for v > and g £ Q, and taking P 
{P{))t, as in the proof of Proposition l2.9l it suffices to show that |jCt*||oo — >■ as (5 1 0, 
uniformly over t e (0,r], with C*' given by (|2T^ . To this end, since CPu = PuC, 
= e~f C and (Aq)/ = —fC, it is not hard to verify that = 4>sCrt ~ V-^Pt^i 
where h = Pyh for h — Cg € Q, the continuous functions (j)s := \ — e^^^ and 
Tps :— 5^^{e^-^ — Sf — 1) are such that ||05||oo + H'/^-ijIIoo — as (5 J, 0, and 
rt = /q Pt^ufPuhdu is in by our assumptions about the space Q of test 

functions. 

With Pt contractive on (I?(Pt), || • ||oo), we thus have that for any t e [0, T], 

llCf lloo < ||0d-||oo||>Crt||oo + ||l/'-5||oo||/l||oo < ll5{f,9,T) , 

with r/s —> as (5 1 0, provided sup{||£rs||oo ■ s < T} < 00. 
To show the latter, recall that 

Crs + fPsh = dsrs = ds{ PufPsSdu) 

Jo 

= Psfh+ I PufCPs-uhdu = P,fh+ [ P^fPs-uChdu, 

Jo Jo 
hence by contractivity of the semi-group P,j, 

||>Cr,||oo < \\fPsh\\oo + \\Psfh\\oo+ f \\PufPs-uCh\\oodu 

Jo 

< 2II/II 

00 1 1 ^ 1 1 00 

which completes the proof. □ 



Theorem 4.2. Suppose in addition to the assumptions of Proposition \378\ holding 
for Sf and all 6 € (0,1], that {p/)tg £ 2?(£ ) for all g £ G , t > 0, and that 
V(Z) C V{C) for C of Corollary with 



(4.1) \\Cr~Cr\\^<-K{rCr 



for some K < 00 and all r £ 'D{C). The semi-groups (Pf)t for the Markovian 
perturbations x({t) on B ^ L2{f^'^) then have a response function of the form 
\2.7^ , now with 

(4.2) A/ = (Ai)^.=.lr(/,.) + /^-/^, 

a linear operator on I?((Ai) f) := {g ■ fg £ T>{C)} H T){C). 
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Remark 4.3. Since (Ai)/ is applied in {2. only on Junctions in the set Q = 
{Ptg ■ g G,t > 0}, it is not hard to verify that ^.2^ is valid even with C and 
r replaced by C and T , and that only the term corresponding to fC in \2. 7| ) might 
not be in Cb{S) (hence requiring the application o/Ps instead of Pg). 

Remark 4.4. Of the conditions of Theorem \4-.2\ it is the least convenient to check 
that r — {P^-/ )tg is in the domain of C . However, we use it only once, to de- 
duce that then {rCr)^o — {rCr)^o. Thus, one can eliminate the former condition 
whenever there is a direct way to verify the latter. 

Heuristically, the condition (j4.1|) tells us that the symmetric part of the dynamics 
is dominant, in the same spirit as our assumption that 'D{C) is contained in both 
and 'D{C^) (and many non-symmetric examples have different domains for C, 
C and C). Nevertheless, in many cases we do not have to worry about domains 
of the various operators and in certain settings arrive at the same conclusion even 
when (j4.ip does not hold (see Section [S] for one such example). 

Remark 4.5. Since /i'^"'" = for any 5 > 0, it is natural to choose Pj-*- = Pt, 
as is the case for X({-), yielding then that = 0. However, this is not always 
done. For example, Pf^ =/= Pf for X^{-), where indeed (Aq)]^ = —C ^ 0. Also note 
that by Definition \2.7\ the response function Rxi ,g{s,t) is always linear in g and 
homogeneous with respect to multiplication of f by a positive scalar. In Theorems 
and \4-.2\ the response function is further linear in f, but this does not always 
apply (see Example \5.4\ for the Metropolis perturbation in which A.^f =/= — A/ ). 

In case of /z°-symmetric processes we get the following corollary upon considering 
C = C = C. The direct proof of this corollary is of course simpler and shorter 
than that of Theorem 14.21 

Corollary 4.6. Suppose Pt is ^'^ -symmetric and that for all S G (0, 1] the generator 
of the fi^^ -symmetric semi-group of Provosition \3.2\ is such that T){C) C 'D{c/). 
These semi-groups then have a response function of the form {2.1^ with (Ai)/ — 
^r(/, •) (whose domain {g G 'T){C) : fg G T>{C)} contains Q ). 

Proof of Theorem 14. 2t Recall Proposition 13.81 that fixing hereafter non- negative 
f G, Assumption 12.51 holds for the Hilbert space T-l = L2{fjP) and further, Q — 
{Ptg : (? S t/, t > 0} is in the domain T>{A) of the linear operator A = (Ai)/ of 
(|4.2p . Due to the linearity of A, for the strong continuity of AP^g in H per given 
g G G, it suffices to show the convergence to zero in T-L of C{Psg — g), P{f, Psg — g) 
and C{Psg ~ g), when s J, 0, per given g ^ Q. To this end, note first that C{P sg — 
g) = (Pg — TjCg (since g,Psg G 2?(£)), with the latter converging to zero in H by 
the strong continuity of Ps. Further, applying (|4.ip for Pad — g € 2?(£), by the 
preceding argument, the convergence of C{Psg — in "H is a consequence of the 
convergence to zero of 

-((P,?-?)£(P.?-5))pO =-((P.5-?)(P.-I)(^?))pO <2||P.?-?|| \\Cg\\, 

by the strong continuity of Ps. 

To deal with the last remaining term, namely r(/, Ps^—g), note that if (hi, /12) G 
2?(r) then Tt{hi,h2) — >■ T{hi,h2) in supremum norm and hence also in when 
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1 1 0, where 

(4.3) Ftig, h) t-^[gh - gPth - hPtg + Ptgh] , 

is a bi-linear symmetric, non- negative definite operator. 

Since Tt{hi, /i2)^ < Tt{hi, hi)Tt{h2, ^12), we have in particular that 

|!r(/,P,5-5)||2 = lim||rt(/,P,5-5)||2 

(4.4) < lim\\rt{fJ)\\o.{rt{Psg-g,Psg-g)),o. 

As (/, /) e 2?(r) we have the convergence of rt(/, /) to r(/, /) in supremum norm. 
Further, the /x^-invariance of Ps results with 

(4.5) {rtiPsg-g,Psg-g))^o^-2{{Psg-g)C{Psg-g)),,o 

as i — > 0, which as we have already shown converges to zero when s — > 0. Combining 
all these facts we get the stated strong continuity of APgg. 

Fixing g = Pvg for v > and g € G, it thus remains only to show that for 
P^ ;= (Pl^)t of Propositions 



pf := S-\Pf -Pt)g- f Pt^uAP.,gdu , 
Jo 



is such that t ^\\pf\\ ^ as S i uniformly in < e (0,r]. To this end, recall that 
the generator :— Ci'^ of the semi-group P( of Proposition 13.81 has exactly the 



same domain as £, so with Q C 'D{C), we see that both Ptg and Pf'g are in the 
domain of £ (and C^), with 

^! = S-\C'Ptg~CPfg)~APtg, 
well defined. Further, as we shall prove at the sequel, 

Lemma 4.7. For any f £ G , g (z G and T < 00 there exists K = K{f,'g, T) finite, 
such that W-ipfW < kVS for all t e [0,T] and 6 e (0, 1]. 



Next, given Lemma l4~7l recall that 

Pfg^Ptg^ I C'Pigdu^ / Pt-uCgdu, 



t ft 



"'0 



from which we conclude by the finiteness of ||AP„5||du and 11-0^11^?/, that 

A:=S[fPt-ui^idu~pf]^ f\pt-u-I)C'Pigdu- f Pt-uL{K9 -9)du . 
Ja Jo Jo 

Fixing t e [0, T] and S > we claim that A = 0. 

Indeed, fixing ft. G tj, by Fubini's theorem and the definition of the adjoint semi- 
group (P )t>o, clearly, 

{hA)^o= f\{Ptuh-h)C'Pig)^odu- f\(£*Plh){Pt_J-g))^odv. 
Jo Jo 

Further, with h £ 'D{C*) and g E 'D{C^), we thus get that also 

(ftA)^o^ /*((/* "p*Xhdv)C'Pig)^odu- [\plfh{f \'Pigdu))^odv. 
Jo Jo Jo Jo 
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By Fubini's theorem, the contractiveness of and P* and the finiteness of ||£ h\\ 
and ll^'^sll, this imphes that {hA)^o — for all h <eQ. So, with Q dense in L2(/i°), 
we deduce that A = as claimed, i.e. = Pt-tii/if du. 

Now, by Lemma 14771 the contractiveness of P* and the convexity of || • || we have 
that ^ 

l\\ < I Ui\\du<tK^5, 



\\Pt\ 

Jo 

thus completing the proof of the theorem. □ 
Proof of Lemma [Hi) Fixing /, /i e tj, for each r e V(C) C V{C) set ^(r) = 
^S.i{r) +£.2ir), where 

(4.6) ^,{r) = {frC*h-hfCr-hrCf)^o and Ur) = {hfiCr ~Cr))^o . 
Next for each r e X>(£) and S e (0, 1] let 

It is not hard to verify that ^(r) = (/iAr)^o whenever r G P(A). In particular, 
with Ptg e 'D{A) and Pfg £ !>{£) this implies that 

(4.7) {hi^f),o = AsiPfg) + aPfg - Ptg) , 

for any 5 e ^, <5 e (0, 1] and t e [0, T]. 

To complete the proof we require the following lemmas, whose proofs are pro- 
vided at the end of the section. 



Lemma 4.8. Under the conditions of Theorem \^.S\ there exists Ki — Ki{f) < oo 
such that for all d G (0, 1], h £ Q and r G 'D{C) 

(4.8) m\ < K,-S{r)'/'\\h\\ , 

(4.9) |A,-(r)| < 6K,-S{r)^/^\\h\\ , 

where £{r) := —{rCr)^o is finite and non-negative for r € 'D{C). 

Lemma 4.9. Under the conditions of Theorem \4-^ for each T < oo and g £ Q 
there exists k = K{f,g,T) < oo such that for all S G (0, 1] and any t G [0,T], 

(4.10) _ £{Ptg) < 

(4.11) EiPlg-Ptg) < Sk. 

Indeed, in view of (|4.7p we get from the bounds of Lemma 14.81 that 
\{h^pf),o\ < K,\\h\\[6£{Pfgr^'+£{Ptg-Ptgr/'] . 

Hence, by the bounds of Lemma 14.91 we deduce that \{hiljf)^o\ < K\\h\\\/S for 
K = k{f,g,T) = 2Kiy^ finite, and all (5 G (0, 1], t G [0,T] and heG. Since G is 
a dense linear subspace of Ji we conclude that < K\fb, as claimed. □ 
Proof of Lemma 14. 8t Fixing f,h G G and r G 'D{£) we start by proving (14. 8p . 
Indeed, with C and C being the generators of the strongly continuous semi-group 
Pt and its adjoint P^ , we have from (14.61) that 

(4.12) a(r) = lim i[(r/P> - hfPtr - hrPtf + hrf)^o] - \un{hTtif,r)} , 
for the bi-linear symmetric, non-negative definite operators 

Tt{hi,h2) := t-^[hih2 - h{Pth2 - hiPth2 + Pt/ii/is] 
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on H X H. Next, mimicking the arguments of (|4.4p and ()4.5p it fohows by the 
/x^-invariance of Pt that 

(4.13) hmsup ||rt(/, r)f <hmsup||rt(/,/)||oo(rt(r,r))^o =2||r(/,/)|U?(r-), 

for aU r £ ^(Z) and / £ X>(Pt) such that (/, /) e X'(r). Consequently, 

(4.14) Mr)\ < ||/j||hmsup||rt(/,r)|| < y/2\\T{fJ)\\^£{ry/^\\h\\. 

Clearly, |^2(r-)| < \\hf\\ \\£r -Cr\\ < v^||/||oo|| g(r)^/^||/t|| b y (ITO and (gH). We 
thus deduce that gl]) holds for any Kiif) > y^\\T{fJ)\\^ + VK\\f\\oo- 

Turning to dH]) and fixing S e (0, 1] let ^5 := <5"He'^^ -Sf -1) e X'(Pt), and 
note that by ((XTl) and (gH) 

(4.15) As{r) = As{r) + {h^p.,{Cr - £r)),,o 
where 

A,(r) := 5-^[{hC'fT)^o - ((1 - e-*0/i£r)^o] - 1^(0 • 

Recall that e~^fh e tj, so using the /^''■''-symmetry of C^^ and the /z'^-symmetry of 
£, followed by the relations p.8p and p.l3p . at g = e~^^h and g = h, we have that 

5[A,(r) + (r)] = (re^-^£^/(e-^'-^/i))^o - {r[Ch - £(e-^//i)])^o 

= (re*'-^£(e-*^/i))^o + ^{rT{e'^ ,e''f h)) - {rCh)^o 

Adapting the derivation of (|4.12p we find that the latter expression is the limit as 
t -J> of ^{he-^fTt{e^f ,r))^o, so in view of (|4J2)) . we deduce that 

Since u i— >■ Tt{u,r) is a linear functional such that rt(l,r) = for any r £ %, we 
further have that 

for (l)s — er^f . With e^''-^ G [0, 1] and ^5 € Q, we thus get as in the derivation 
of (|iT^ and that 

l|A5(r)|| < i||;.||[limsup||rt(7^5,r)|| + ||(/>,-||oolimsup||rt(/,r)||] 

< fco(5,/)f(r)i/2||/j||, 

for ko {SJ) = ^||r(?/;5, ■06)1100 + ||05||oo VPXATIIU finite. Combining this with 
(|4.15p and (|4?T|) we thus deduce that 

\\Asir)\\ < ||A,-(r)|| +||/i||||V^_5||oo||£r-£r|| <A;i(<5,/)£(r)i/2||/i||, 

where ki{S, f) = kQ{6,f) + v^H^-iHoo- Thus, we establish (|4.9p once we show 
that ki{S, /) < SKi{f) for some finite Ki{f) and all 6 € (0, 1]. To this end, recall 
that ||05||oo < S\\f\\oo and ||V'-5||oo < ^||/||L/2 for any non-negative / G I?(Pt) 
and (5 > 0. Further, for any g £ Q, as t the non-negative functions Tt{g,g) 



22 



AMIR DEMBO JEAN-DOMINIQUE DEUSCHEL 



converge to T{g, g) with respect to the supremum norm, so it remains only to check 
that for any 5 G (0, 1] and t > 0, 

(4.16) Tt{i^s,^5) < (e'"^'l~ -l)2rt(/,/) 

(indeed, using the bound e'^" — 1 < Se^ in (|4.16p rcsuhs with (14. 9p holding when 
Kiif) > (ell/ll- + ||/||oo)VI|r(/,/)l|oc + %/i?||/||L/2). As for ^B, recah that 
for any x,y G S and ^ > 0, 

rf{y) 

\My) - M^)\ = I / (e'" - l)du\ < cslfiy) - f{x)\ , 
for cs = e'^ll-^ll°° — 1. Consequently, 

rt(V'5,V'5) =t-'lEx[(^5(X(t))-^5(a;))2] < c,?riE,[(/(X(i))-/(x))2] = c^rt(/,/), 
which is exactly the inequality (|4.16p . □ 

Proof of Lemma 14. 9t Fixing T < oo, f £ G and g £ G, recall that (/i,g) G 
V{T) C V(r) for any /i G t?. Consequently, then Tt{h,g) T{h,g) as t ^ 0. In 
view of (|4.13p and (|4.16p we see that 

m^Ps,g)f < 2\\T{^Js,^5)\\oom < 2(e'"^'l- - inTifJ)\\^S{g) 
are bounded uniformly in 6 £ (0, 1]. Further, since e^^ — S^s + + 1, 

(4.17) ||r(e^^?)|l < <5|lr(V.^,?)|| +<5||r(/,g)|| < noUmr^' 

are also bounded uniformly in S £ (0, 1] (take ko(/) = e'l^'l"" ■\/2||r(/, /)||oo finite). 
Turning to prove (|4.10p . note that for any 5 e (0, 1] and r £ V{C), by p.l4p . 

-{rCYr)f,sf = -{rC^fr)^sf - (r£r)^o > £(r) 

since /C'^-'^ is the generator of a /i'^ •''-symmetric, strongly continuous semi-group whose 
domain contains ^{C), hence a negative self-adjoint operator on this set. With 
a contraction for the norm of L2{iJ.^^) (denoted hereafter by || • \\s), we thus find 
that for any g £ G and t > 0, 

SiPfg) < -{{Pfg)iPtt/g))^sf < \\g\\s \\c'/g\\s. 

Further, / is non- negative and by our assumptions, g is in Vf of (|3.9p where the 
identity p.Sp applies. We thus establish the uniform bound of (|4.10p upon noting 
that both \\g\\s < ell^"°=||5|l and 

Wc'/gWs < WC'^gWs + We-'^ms 

(4.18) < ^(||£?|| + ||Z*5ll + l|r(e'^,?)ll)+ell/ll-||Z?|l 

are bounded uniformly in (5 £ (0,1] fsee (|4.17p for the uniform bound on ||rfe'^-'. q)||). 

Next consider the non-negative quadratic form £{hi,h2) '■= —{hiCh2)^a on 
V{C) X V{C), noting that £{r) = E{r,r) for ah r £ V(C) n V(f), due to ((3l3l) . 
Turning to prove (|4.1ip . by our assumptions this is the case for rf := PfTj — Pig, 
hence w{ := £{rl) = £{rf,rf). Further, i i-> := dtrl = C^Pfg - CPtg is 
uniformly continuous, since 

(4.19) sup \\af-al\\<snp\\{Pi-I)C'g\\+sup\\{P^-I)£g\\=:es{B) 
\t-s\<e u<e u<0 
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which converges to zero when 6* | 0. With bf = af ~ Crf, we show next that 

(4.20) 116^11 < 26Kiy^, 

(4.21) llZrfll < «i, 

for some finite ki — g), the universal constants Ki and k of Lemma 14.81 and 
(|iJUl) . respectively, all t > and S e (0,1]. Indeed, bf = C^Pfg-CP^^g, hence 
(/i6^)^o = (5[A5(Pfg) +.^(P^5)] for any heQ. Thus, by LemmagHand (|4J0)) 

|(;i5f)^o| < <5A-i(<5+ l)||/i||£(Pfg)i/2 < 5K,{5+l)V^\\h\\ , 

and with Q dense in L2{fjP) this immediately yields the bound of (I4.20p . Turning 
to prove (|4.2ip . note that for any t > and S G (0, 1], by (|4.20p the contractivity 
of Ft on L2[yP) and the contractivity of on L2(/i'^-^), 

llZrfll < \\C'vlg\\ + \\bl\\ + \\CVtg\\ _ 

< e\^f\\^\\C^g\\s + 2KiV^+\\Cg\\, 

with the right side bounded uniformly in 5 G (0, 1] by some finite ki = ki(/, > 1 
(see (I4TT8)) for details). 

As C is /i'^-symmetric, by Fubini's theorem, for any s' > s, 

u;f,-ii;f-(s'-5)[£(af,rf)+f(4,rf,)] £{ai-airt)du^ J^^ £{ai-ai,ri)du . 

Recall that by (|4.ip and (|4.21l) . for some universal finite constant K, 



(4.22) ||£rf II < ^Kwf + \\Crf\\ < Kwf + , 

so by the uniform continuity of t , see (|4.19p . 

wl, -wl- {s' - s)[S{alrl)+£{al,,ri)] < {s' - s)es{s' - s)[Kwi + Kw^ + 4ki] . 

Further, by (|4.ip also 

8{al - bf,rf) = -2{(Crf)Crf),o < \\Crf -Crff < KE{4) = Kwl . 

Combining the latter pair of inequalities and the bound £{bf,rf) < ||6t ||||>Crt ||, we 
deduce from (|4:20)) and (1422)) that if es{s' - s) < 2SKiy/K, then 

wf' -wi< {s' - S)[i^2wf' + K2wi + K26] , 

for some finite universal constants K2 = K2{Ki, k, K), K2 — K2{Ki, k, ki) and all 
S G (0, 1]. Since Wq = 0, iterating the latter bound n times, for s' — s ~ t/n, then 
taking n — 00, we conclude that < 5k2 /q e'^^^'^du for aU 5 G (0, 1] and t>Q. 
That is, (|4lT|) holds for k(/,5, T) = K2 Jq e^^^^du finite. □ 

5. Pure jump processes on a discrete state space 

We consider here pure jump processes X(t) on a countable (or finite) state space 
S equipped with the discrete topology, such that the total jump rate at state x is 
bounded uniformly over x S. That is, the jump rates c{x, y) > from x to y ^ x 
are such that 

(5.1) sup > c{x,y) < 00 
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(which triviahy holds when the set S is finite). Recall that to each such process 
corresponds a strongly continuous Markov semi-group on the Banach space Cb of 
all bounded functions on S, the generator of which is the bounded linear operator 
£ : Cf, — ?► Cb such that 

(5.2) Cgix)^ J2 c{x,y){g{y) - g{x)) . 

Conversely, any operator of the form (|5.2[) with non-negative c(x, y) satisfying ()5.1|) 
is the generator of such a Markov process, and taking in this context Q = Cb elim- 
inates all technical issues of the previous sections (about the domains of various 
generators). Further assuming that the process X{-) is irreducible, let /i°(-) de- 
note its unique invariant probability measure, identified hereafter with the positive 
function /i"(.x) := ijP{{x}) on S. Recall that necessarily, 

(5.3) ix\x) c{x,y)^ M°(z/)c(2/,a;), Va; G 5 . 

We proceed to compute in this case the response functions for our two generic 
Markov perturbations. To this end, consider the operators and £ = ^(-C + 
of the form (j5.2p but for jump rates 

c*{x,y) 

c{x, y) 

respectively. By (|5.3p . both c*(-,-) and c(-, •) satisfy (|5.ip so C* and C are both 
bounded operators on Cb and the generators of strongly continuous, Markov semi- 
groups on Cb, denoted and Pt, respectively. It is easy to check that Pj is the 
adjoint of the original semi-group Pt and that Vt is the /i^-symmetric, strongly 
continuous, Markov semi-group of Corollarv l3.7l (both restricted to Cb C L2{ijP)). 

Given a non-negative / € Cb, both Propositions 13. 1] and 13 .8] applv here, and their 
generic perturbations correspond to the bounded operators £q and C{ on Cb having 
jump rates CQ{x,y) — e" ^ c{x , y) and 

c{x,y) + i(e/fe)-/(-) - l)c{x,y) + ^^e' ^ ^-\c{x , y) - c'^(x,y)) 
i(e/(f)-/(-) + e-^("))c(a;, y) + ^(1 - e-^("))c*(a;, y), 

respectively. Theorem 14.11 provides the response function for ^o(-) which in this 
case has a bounded operator (Ao) / on Cb of the form 

(5.4) (A/)g(a:) = ^ af{x, y){9{y) - g{x)) , 

y:y=^x 

with aQ{x,y) — —f{x)c{x,y). Consider the bounded operator (Ai)j of the form 
with 

f f 1 1 

a{{x,y) = a5(x,2/) + -f{y)c{x,y) + -f{x)c*{x,y) , 



^c(y,x), x^y, 
l-{c{x,y) +c*{x,y)) 



c{{x,y) = 
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and let 

£,s{x,y) 5^^{cl^ {x,y) - c{x,y)) - a{{x,y) 

= 2'^-s{f{x))[c*{x,y) - c{x,y)] + -ips{f{y) - f{x))c{x,y) , 
where fsiT) ~ S^^{e^^ — (5r — 1) — > as (5 — > 0, uniformly on compacts. Hence, 



(5.5) ]"J?,^^P X! \^s{x,y)\=0. 

This in turn implies that p.lOp holds for £( and (Ai)/, so by Proposition 12.9 



IT C{ a. 

we deduce that the Markovian perturbations x[{-) have the response function 
associated with (Ai)/. 

Suppose now that A/ is of the form ()5.4|) and that 

(5.6) sup ^ \af {x,y)\ < CO 

y-v=Fx 



which guarantees that A/ is a bounded operator on Ch- In view of Theorem 12.101 
for such Aj to correspond to the response function of some perturbation (•) (per 
Definition 12 .yp . it is necessary that af{x,y) — bf{x,y) — f{x)c{x,y), where 

(5.7) b''f{x,y) = rbf{x,y), r>0 

(5.8) fi°{x) bHx,y) = ^ /(2;)6^(y,x), \fx e S . 

Slightly modifying the time change generic perturbation of Proposition 13.11 we 
next show that essentially these conditions on {x, y) are also sufficient for having 
a perturbation {■) whose response function is given by \2.7\ . 

Proposition 5.1. Suppose that the generator of the semi-group Pf of a pure jump 
Markov process X{-) on a discrete state space S is of the form I15.2\) for jump 
rates c{x,y) > that satisfy i5.1\} . To any Af of the form |5.^[ ) with a^{x,y) — 
b-^{x,y) — f{x)c{x,y) satisfying I15.6\) - [5T^) and such that for some < oo, 

(5.9) b^{x,y) > -p^c{x,y) Va; 7^ y , 

there corresponds a Markovian perturbation Xf{-) satisfying Assumption \2.5\ whose 
response function is Rxf^gis^t) = Fs-^f^t-sg (for g G Cb). 

Remark 5.2. Condition h5. implies that b^ {x, y) is non-negative for every x ^ y 
such that c{x, y) ^ ( and for a finite state space S it puts no other restrictions on 
bf{x,y)). 

Proof: In view of ()5.7p and ()5.9p . if (5 > is small enough so 1 — 5p^ > then 

(5.10) 7^J{x, y) = [c{x, y) + b'f{x, y)] = c'J {x, y) + e-'f^'^'^b'f{x, y), 

are non-negative for all x ^ y. Further, by the boundedness of /(•), (|5.ip and (|5.6p 
we have that "^y^J {x,y) is bounded, uniformly in x £ S. Thus, there exists a 
pure jump Markov process X^'^ {■) on S whose semi-group is generated by a bounded 
operator C^J on Cf, of the form (j5.2p with the jump rates T^J (x,y). Moreover, it 
follows from (fOj) . ([5^ and ([5T0| that 

{x) c^J {x,y) = m^'^- {y)<^J (y , x) , Vx e 5 

y.y^x y-y^x 
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(where fJ.^-^ {x) — e'^-^'^V^l^^))- This miphes that IJ^^-^ {■) is a finite, positive invariant 
measure for the semi- group of the irreducible Markov process Xq'^ {■), which thus 
satisfies Assumption 12.51 (with Q ^ Cb — B). It is easy to check that (|5.5p holds for 
£^s{x,y) := 5~^{^J {x,y) — c{x,y)) — af {x,y). This in turn implies that (I2.10p holds 
in this setting, so by Proposition 12.91 we deduce that (|2.6p holds as well, and that 
A.f'PsQ is strongly continuous on C;,. □ 

Remark 5.3. We alternatively get the response Junction Rxf ,g{s,t) = PsA.fPt-sg 
per Provosition \5. 1\ by adapting instead the generic perturbation of Provosition lSTR 
i.e. following the same line of reasoning for the Markov perturbation xf'^ {■) that 
correspond to the jump rates 

Sf/(x, y) = (x, y) + e-^^(-) {b'f{x, y) - ^-f{y)c{x, y) - ^-f{x)c*{x, y)) . 

Indeed, for f{-) non-negative and 6 > also tps — S~^{e^-f — 6f —1) is non-negative, 
so by (i^ and (EW 

e^f^^'>4^{x,y) = c(x,y) + b^f{x,y) + -[i^s{y)c{x,y)+^s{x)c*{x,y)] 

> c{x, y) + 5b^ {x, y) 

is non-negative as soon as 1 — 5p^ > 0. With tpg G Cb it follows from I15.1\) and 
\5.6\) that of the form US. ^|) corresponding to jump rates c^/ {x, y) is a bounded 
operator on Cb hence a generator of a semi- group for a Markov process X^^ {■). 
Further, from the fjP -invariance of C and B/ = A/ -|- fC, see 115. 3\) and i5. (§)) . it 
follows that {C\^ g)^5f — for all g E Cb and so the irreducible Markov process 
Xq^ {■) satisfies Assumvtion \ 2.5\ Finally, with HV'a'IIoo — >■ as (5 ^ we get the 
stated response function upon checking that \5. 5\] holds for (^s {x , y) = 6^^{'c^i'^ {x,y) — 
c{x,y)) - af{x,y). 



Cycle decomposition provides a canonical construction of Markov processes on a 
discrete state space with a prescribed invariant measure (such as fi-^). For simplicity, 
we consider only cycles of finite length. More precisely, equipping S with any 
complete order, let F denote the collection of all finite oriented cycles 7. That is, 
7 = {xo,Xi, . . . ,Xn) of length n = I7I > 2 is such that Xn = xq and Xi 7^ Xj for 
all < i < < n. Suppose a strictly positive probability measure /i° on S and 
a : F i-^- M_|_ are such that 



is finite (in particular, if S is finite then so is F and ||a||r < 00 for any a : F 1— ^ K). 
It is then easy to check that the jump rates 

(5.11) c(x,y) = ^j— ^a(7)l 

satisfy (|5.ip and that is an invariant measure for the corresponding semi- 

group Pf Further, this semi-group is /z°-symmetric (i.e. the Markov process is 
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reversible), if 0(7) = whenever I7I > 2. Next, let : T H> M and : T H> M+ 
for / e Cb be such that 11/3-'' ||r is finite, fV^ — rji^ and 

lini||^-i(a''-''- a) ||r = 0. 

(5^0 

Then, applying once more Proposition I2.9[ we deduce that the Markov process of 
jump rates 



has an invariant measure [i^ and the response function corresponding to 
a^(x, y) = -f{x)c{x, y) + ^ ^^(7)l(x,j;)e7 ■ 

We next consider some concrete examples such as the Glauber and Metropolis 
dynamics for Gibbs measures on finite graphs. 

Example 5.4. Consider a finite graph with S denoting its vertexes and the sym- 
metric E (- S X S denoting its edges. Given H : S R let — e^^^^^ de- 
note the corresponding non-normalized Gibbs measure and consider the reversible 
Markov processes obtained by \5.11]) when £1(7) > if and only if"f= {x, y, x) with 
{x,y) G E. That is, having jump rates 

c{x, y) = e"^'''>a{x, y)l(x,y)eE , 

for a{x,y) — a{y,x) > 0. Two such examples are the Metropolis dynamics where 
ctM{x,y) = mm{e~^^^\e^^^y^) and the Glauber dynamics for which aG{x,y) = 
l/(e^^^)+e^^^''). The Markov perturbations one uses for the Metropolis (or Glauber) 
dynamics are of the same type as the original process, just replacing H{-) by H{-) — 
5f{-). Here the convergence in \\ ■ ||r is equivalent to a point-wise convergence on 
E leading to the response functions that correspond to 

f e-^" 
aci^iV) = ifiy) 'fix))- 77772 l(^:!y)ei5' 



where AH :— H{y) — H{x). Note in particular that while Oq is linear in /(•), this 
is in general not the case for a'^ . 



6. Finite dimensional diffusion processes 

Here 5 is a connected, finite dimensional C°°-manifold M without boundary. We 
first consider compact M, with the treatment of non-compact M — R'' provided at 
the end of the section. Let f/' be a probability measure on M that has a smooth 
strictly positive density with respect to any coordinate chart for M (c.f. [31 Section 
6.3]). Setting Q = C°°{M) and r(T(Af)) denoting the space of smooth sections 
over M, recall that in the absence of boundary, for any Z e r(T(A/)) there exists 
then a unique gz ^ G such that Z*/i = —Zh + gzh acts on G as the adjoint of Z 
with respect to the inner product of L2(m°) (and gz = Z*l). For e r(T(M)), 
i — 0, 1, . . . , d, consider the operator £ = X^iLi o + Dq on Q (that is, a 



28 



AMIR DEMBO JEAN-DOMINIQUE DEUSCHEL 



diffusion generator in tlie Hormander form, see |13]). Any sucli operator can be 
rewritten as 

d 

£=-^D*oD,+Y, 

1=1 

wliere Y = Dq + X]f=i ^-^^o in r(T(M)). Note that sucfi operator is tlie 

restriction to Q of tlie generator of a strongly continuous Markov semi-group P* 
on Cb = Cb(5) such that Q = G = C°"{M) (see for example, [3 Theorem 6.3.2]). 
In particular, the corresponding Markov process X{-) can be constructed as the 
unique solution of a certain Stratonovich stochastic differential equation (S-SDE), 
c.f. [31 Exercise 6.3.22]. 

Also, the semi-group Pt is //^-invariant if and only if = (see [3l Theorem 
6.3.2]). In particular, if {Di,...,Dd} satisfies Hormander's strong hypo-elliptic 
condition (i.e. (H) of [3l Section 6.3]), then for any Dq G r(T(M)) there exists a 
unique probability measure (of a smooth strictly positive density with respect 
to any coordinate chart) for which = 0. Wc next provide the diffusion process 
X({-) of the generalized Langevin dynamics of Proposition 13.81 and its response 
function. 

Proposition 6.1. Suppose g-y — and for any non-negative f £ C°°{M) let 
Yf - e-fy + Eti(D./)D,. Then, 

d 

i=l 

is (the restriction to Q = C°°{M) of) the generator of a strongly continuous, ^i^ - 
invariant Markovian semi-group (?{)* on Ct with Q closed under the action of 
this semi-group (and the Markov process X({-) is the unique solution of a certain 
S-SDE). If further 

(6.1) / |Yg|2d/<X^ / jD.gl^d/, 

Jm -^-^ Jm 

for some K < oo and all g G Q, then x({-) has a response function that corresponds 
to (Ai)y = X]i'=i(Di/)Di — /Y, a linear operator of domain Q. 

Remark 6.2. The process X({-) is a diffusion on M that differs from X() only by 
the addition of a smooth drift term corresponding to Y-' — Y. We note in passing 
that X{-) is reversible (i.e. has a fj? -symmetric semi-group) if and only if'Y = 0, 
in which case the added drift is of a gradient form (and x[{-) is known in the 
literature as the Langevin dynamic). 

Remark 6.3. //Dq Ei=i for some hi £ L2{^jP), then Girsanov transfor- 

mation shows that the laws of x((-) and X{-) are mutually absolutely continuous 
on C([0,T];M) for each T < oo. The Langevin dynamic is in this respect more 
natural that the time change generic perturbation (of generator Co = e^^C), for 
which this is of course not the case. If in addition hi G Loo{^i^) for i = 1, . . . , d 
(as for example, in case of uniform ellipticity), then the condition ^6.1]) is trivially 
satisfied. 
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Proof: Our assumption that = means that Y* — — Y. Hence, acting on Q, 
the adjoint 

d 

= ^ D* o D, Y 

of £ with respect to the inner product of L2{fjP) is such that £*Q C Q. It is thus 
the restriction to G (and a core) of the generator of the adjoint semi-group 
on Cb, with Q closed under the action of P^ . Consequently, the generator of the 
/j,°-symmetric semi-group Pt of Corollary 13.71 is just C ~ — X^iLi ° (when 
acting on G). Moreover, here 

d 

(6.2) r(/,g) = 2^(D,/)(D,5) 

1=1 

satisfies the Leibniz rule T{fh,g) = hT{f,g) + fT{h,g), so r{e-^ ,g) — efr{f,g) 
and for any non-negative f G G, the generator of the yu^^-symmetric semi-group P( 
of Lemma [3.51 is such that for g £ G, 

d d 

= -(1 - e-f) J2 ° + ^(D,/)(D,g) . 

It follows that when acting on G the generator C{ — C-^ +e~fC we use in Proposition 
13.81 is merely 

d 

£{ = -5]D*oD,-fY/. 

It is easy to check that for any Z e r(T(M)), the operator Z*'f = -Z + {gz - Z/) 
acts on G as the adjoint of Z with respect to the inner product of L2{fi^). Further, 
with Ye".^ = -e-^Yf, it follows that 

9e-fir - e"-^ Y/ = e^^ gy = . 

Thus, C{ = - ^T'^ ° + e-^Y, and (e-^Y)*-^ = "(e^^Y). Hence, by [3 
Theorem 6.3.2], now with respect to the finite measure fj,-^ on M that is also of 
a smooth strictly positive density, we find that C{ is the generator of a strongly 
continuous, /i^-invariant Markovian semi-group (Pf )t on Cb such that G is closed 
under its action, with X({-) characterized as the unique strong solution of some 
S-SDE (this direct construction bypasses that of Proposition I3.8P . 

Carefully examining the proof of Theorem 14.21 one verifies that there is no 
need to ever consider functions outside G in case this algebra is in the domain 
of the generators £, C* , C, C^^^ and is closed under the action of the corre- 
sponding Markovian semi-groups on Cb- It then suffices to define the operator 
(Ai)/ of (|4.2p only on G and since here £ — £ = Y we deduce from (|6.2p that 
(Ai)/g — ^i^i{Dif)iJ^ig) — fYg for all g G G, as stated. Further, it follows that 
in such a situation xl{-) has the response function corresponding to (Ai) j as soon 
as \\Cg ~ Cg\\^ < ~K{gCg)^o for some K < oo and all g € G, which is exactly our 
condition (|6.ip . □ 

Consider next the non-compact manifold M = IR'^, denoting by C°°, C^, 
the collections of smooth functions, smooth functions with bounded derivatives of 
all orders, smooth functions of compact support on Af = M'', respectively. Let G 
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be the vector space spanned by 1 and the collection of Schwartz test functions on 
M (i.e. functions in Q are elements of C°° whose derivatives of all positive orders 
decay faster than any power of ||a;||), and consider the Markovian semi-group Ft on 
Q that is generated by £ = X^iLi o -I- Dq where for i = 0, . . . , d, 

^ d 

with aj,fc e for i > 1 while ao.k G with G for k, j = 1, . . . , d (that 

is, the drift of our diffusion may be unbounded, but its derivatives are bounded). 
Hence, 

d ^^2 d. 



Cj.feT; — 'r'S^bj—— 

j.k—l j — 1 ■' 



where for each x G M, 



d ^ d 

^jyf' ~ ^li.iOi.fej bj — aoj + ^ Gi^k ■ 

Suppose that {Di, . . . , D^} satisfies Hormander's strong hypo-elliptic condition and 
there exists a bounded below Lyapunov function V S C°°, such that £V < and 

lim V{x) — oo. 

This implies that the diffusion has a unique invariant measure ijP with a strictly 
positive smooth density p G with respect to Lebesgue's measure on M (see [6]). 
In view of [TSl Theorem 3.14] the semi-group Pj maps G into itself (more precisely 
they require bounded drift, but under our assumptions, for Dq of linear growth 
the transition probability function has sub-Gaussian tails and once this is shown, a 
localization argument reduces to the case covered in [T5]. An alternative approach 
is to use that fact that ii g G G then CPtg = Pt{^g), where Cg € G and use the 
weighted Sobolev norm estimates of [3 Theorem 4.1]). 

Now take / e and upon making the relevant modifications, apply Proposition 
I6.1l in this setting. 

7. Stochastic spin systems 

We consider next systems of locally interacting diffusion processes, indexed by 
the d-dimensional lattice . Such processes naturally arise in statistical physics, 
where all Gibbs states of the interaction potential are invariant measures for the 
chosen dynamics. In particular, in the presence of a phase transition we typically 
have non-uniqueness of the Gibbs state and infinitely many invariant measures for 
the Markov process X{-). Note that in contrast with the setting of Section [51 here 
the state space S is such that we typically do not have an obvious dense algebra 
of test functions G in 2?(Pf ) which is closed under the action of the semi-group Pt 
(for example, the algebra of functions depending on finitely many coordinates is 
typically not closed under action of Pi). 

For simplicity we restrict ourselves to pair interaction potentials and consider 
first the simpler case of compact spin spaces S = (S^)^ , with spins taking values 
in the one dimensional torus (equipped with Lebesgue measure and its cr-algebra 
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Si), and having smooth, symmetric, finite range interactions. Specificany, for x = 
{xi,i £ Z'') and any V CC Z'* (i.e. V finite), consider the Hamiltonian 

(7.1) i/v(x) = ^ $,(!•,) + ^ J2 J2 

where the potentials $i G C°°(S^) and G C°°(S^ x S^), i ^ j are such that 
^t,]ix,y) = $jv*(2;,2/) = '^ijiy^x) and $ij = if |i - j| > r. Let 

i7,(x) := i/{i}(x) = $i(xi) + '^iJi^^^^3) ' 

where iV(i) = {j G Z"^ : 1 < |i — j| < r} denotes the r-neighborhood of i, excluding 
i. Given smooth functions *i(x) = ^'i(xj, j G N{i)) G C°°((Si)^(*)), set 

6,(x) = - J2 <i'-,(^.^.) + *.(x)e^'^^\ 

where <&-(a;) = dx^i{x), <i>-j(a;,y) = dx^i,j{x,y) (and hereafter cJ^; denotes the 
smooth section corresponding to this differential operator on the C°°-mamfold S^). 
We assume that 

(7.2) sup|$UO)|<C, sup I $^,^ (0,0) I <C, 

(7.3) inf inf (x) > -K, inf inf $ ■' (x, y) > -if 

i X i^j x,y --^ 

(7.4) sup\dxdy<^^,j{x,y)\ < c(i-j), 

(7.5) sup|*,(0)| < C, sup sup sup|9,^*,(x)| < C 

i i jeN(i) X 

for some finite constants C, K and c(fc). Under these conditions there exists a strong 
Markov process X{t) on 5 = (S^)^"* (equipped with the corresponding product 
topology) , which is the unique strong solution of the system of stochastic differential 
equations 

(7.6) dX,{t) = bi{X{t)) dt + ^/2dW^{t), i G 

where Wi{t), i G Z'^ are independent Brownian motions on (c.f. I23|). 

We note in passing that with compact, conditions (|7.2p - (l7.5p trivially hold 
for example whenever i i— > $i, i i— > and i— >■ are translation invariant 
(and also in some other cases). 

Let Q denote the dense subset of Cb{S), consisting of all local smooth functions. 
That is, g = {C°°((S^)^) for some V CC Z'^}. Restricted to the algebra g, the 
generator of the corresponding semi-group Pt on Cb{S) takes the form 

(7.7) £ = ^(D,oD, + 6^D,), 

i 

where Dig = dx^g- Hence, Cg G g for each g € g. 

The solution X{t) of (|7.6p is smooth with respect to X{0) = x with derivatives 
Y^jit) = dx,X,{t) such that Y,j{t) ^ Y.k B,k{X{s))Ykj{s)ds and r„(0) = l,(i), 
where by our assumptions Bik = Ti^bi are uniformly bounded and the sum is over 
the finite support of the local function hi. While Pt^ is not necessarily local for all 
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g G (so G is not closed under the action of this semi-group), nevertheless by the 
chain rule DiPtg = '^i^'Ex['Dkg{X{t))Yik{t)], which is thus uniformly bounded in 
X (c.f. the proof of Theorem 2.2] or [T2] which further shows the existence of 
a smooth transition probability density). Further, iterating this procedure to deal 
with the second derivatives, one easily verifies that for all g G G, 

(7.8) ° ^idWoo + J2 < °° ■ 

i i 

In particular, hPtg G 'D{C) for all h,g ^ G and the form (|7.7I) of C extends to any 
such function. 

Under our assumptions the collection G($) of Gibbs measures associated with 
the potentials i,j e Z'^} is non-empty (see [12]). That is, fj, G G($) if 

and only if the DLR equations /g (dy|x)^(£ix) = /x(i?) hold for all B £ Sf and 
V CC Z'', where the probability measure /iy(-|x) on (S^)^ has the density 

//y(y|x) = „ \ . exp(-iJy(y)) TT 4, (?/»), 

with respect to Lebesgue measure on this set (and Zy (x) e M+ is the corresponding 
normalizing constant). Since has no boundary and dxi'^i — 0, considering the 
form (17. 7p and the DLR relation for V = {i}, it is not hard to verify that {Cg) ^ = 
for any fi E G(<i>) and g € G- That is, any measure in G(<i>) is invariant for X{t). 
Further, fixing e G((f>), upon using the explicit form of the local specification 
/Z{i}( • |x) and integration by part, it is easy to check that for all 5, /i G 2?(Di) and 
for fjP-a.e. x e 5, 

(7.9) (/iD,g)^(,j(.|,) = {g{H[h - D,;i))^,,j(.|,,) 

where H[ = GiH^ = ^ii^i) + J2j(^N{i) ^iji^'-^^j) is in G- That is, the operator 
D* = — Di + having the same domain as Dj, is the adjoint of in L2{yP)- In 
particular, 

Z = ^(-DtoD, + *,e^-D,), 

i 

with its adjoint in L2(pP) 

i 

having the same domain as C and such that C G G- Consequently, the same 
applies for the self-adjoint operator £ = — J^i D*oDj (whose domain thus contains 
that of C). 

When '^i — for all i, the Markov process X{t) is merely the usual reversible 
Langevin dynamic and G($) is then precisely the collection of measures for which 
its semi-group Pt is symmetric (see [23l Theorem 4.3]). In this case, it is further 
known that for d ~ 1,2 there are no other invariant measures for Pj (c.f. jl2|). 

Fixing a non-negative, smooth, local function / e C°° {{S^)^) for some U CC Z"* 
(with / 7^ 0), and /i" £ G($), the probability measure = Zj^e^f/' (with 
Zf = {e^)fj^o) is a Gibbs measure corresponding to potentials {(f>i, i, j G Z'' 
and $[/ — — /}. Consequently, ft^ is invariant for the strong Markov process {t) 
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which is the unique strong sohition of the SDE (|7.6p with drift 

b{ = -H^ + nj + eMH^ - fluii)) , 

provided S C°°((Si)^(*)) satisfy ([73]). For example, when taking *f = the 
generator of the corresponding semi-group coincides with £f + e^^£ of Lemma [23] 
and Corollary 13.71 at least when acting on smooth functions satisfying (|7.8p (and 
in particular, on Q). 

We now seek for which this Markovian perturbation has a response function. 
To this end, suppose first that '^i = for all but finitely many i E Z'^. In this case 
we may and shall enlarge U so 5'^ — for all i ^ U in which case taking ^I^^ = 
results effectively with the Markovian perturbation X({-) of Proposition 13.81 The 
same argument we used to derive (|7.9I) also shows that (r^'ie^'Djr)^^.^(.jx) = for 
fjP-a.e. X G 5 and any r £ I?(Di). Consequently, for any r G 'D{C), 

i 

and applying Cauchy-Schwarz inequality we see that the condition (j4.ip holds here 
for K — J2ieu ll^j^^'lP finite. In view of Remark 14.41 we can apply Theorem 14.21 
and conclude that this Markovian perturbation yields a response function (in the 
sense of Definition 12. 7p . that corresponds to 

(7.10) A; = ^(DJ)D,-/^*,e«'D,. 

Whereas the condition (|4.1I) typically fails to hold when is non-zero at infin- 
itely many sites i g Z'*, the perturbed drift b{ with ^{ — '^i (where now U — Uf 
remains the domain of /), can be directly shown to still yield the response func- 
tion corresponding to the operator Ay of (|7.10p . While we do not detail this 
argument, note that we merely replaced the non-symmetric part of the pertur- 
bation (namely, (1 — e~^){Lr — Cr)), by the "localized" non-symmetric operator 
(1 — e^^) J2i£U ^jfi^'Dir, which as we have seen, is dominated by —{rCr)^a (and 
we can handle the latter as in the proof of Theorem 14. 2p . 

Considering next the case of unbounded spins, where is replaced by M, we 
restrict the state space S to the subset of tempered configurations x e such 
that |a;iP(l + |*|)~^'' is finite for p large enough. Considering only the usual 
Langevin dynamics where ^'^ = and assuming once more that (|7.2p - (|7.4p hold, 
guarantees the existence of a strong Markov process X{t) with state space S which 
is the unique strong solution of the SDE (|7.6p . see [23]. In this setting we take 

G = {gE C°°(R^), y CC Z'', d^^g has a compact support in K^, Vi € V} , 

where again (|7.7p holds and £Q C Q. 

Generally Ptg is neither a local function, nor having derivatives of compact 

support, so once again Q is not closed under the action of P^. Nevertheless, under 

suitable assumptions (|7.8p holds, the process X{t) has invariant (Gibbs) measures 

and the /i-'^-symmetric Markovian semi-group associated with the perturbed drift 
f . 

bi yields the same explicit response function as before. For example, as shown in 
[23] . the set G($) of Gibbs measures is non-empty when for some 6 > J2k '^i^) 

sup(6x^ — x^[{x)) < oo . 

x,i 
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